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ABSTRACT 



A generalized signal processing device for use as a 
hearing aid generates and modifies signals representa- 
tive of acoustic patterns in a physiologically compatible 
manner which enables persons suffering from various 
auditory pathologies to recognize sound patterns in- 
cluding human speech. 

7 Claims, 12 Drawing Figures 
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brane will be broad enough to excite adjacent hair cells, 

SIGNAL PROCESSING APPARATUS and if these cells exist, a signal will be sent to the brain. 

However, the amplification does nothing to restore 

BACKGROUND adaptivity, and the function of identifying important 

This invention relates generally to hearing aids and 5 sounds from background noise can occur only with 

more particularly concerns a method and apparatus for conscious effort at higher levels of the brain. Applicant 

improving hearing communication in persons with vari- postulates that this effort is fatiguing and is the reason 

ous hearing deficits. The invention will be disclosed in why . the adjustment period for a hearing aid user is 

connection with a generalized signal processing unit difficult. In more advanced disease of the sensory-neu- 

which restores meaningful neural patterns to the audi- ra * network, adjacent channels may not be present for 

tory recognition centers of the brain in a manner which stimulation by signals which are amplified to levels 

enables persons and other higher animals to recognize a which can be physically damaging to the auditory 

variety of sounds including human speech. structures. In these cases the portion of the frequency 

The present invention is derived from an understand- , spectrum which has no neural channels must be read- 
ing of the physiological processes of the normal hearing dressed to other still viable neural channels, and the 
apparatus, and the manner in which the auditory system adaptivity function belonging to the lost frequency 
is compromised in conditions of hearing loss. The hear- portion must be performed external to the ear. 
ing apparatus in humans and higher animals consists of A variety of hearing aid devices have been proposed 
mechanical parts which transmit acoustic pressure 20 for addressing the problem of sensory-neural deafness, 
waves from the air to the sensory neural network. The The methods and means of the previous methods have 
function and pathologies of the conductive portion of utilized band shifting of frequencies, various transfor- 
the hearing apparatus are well known up to the point of mations of the auditory signal, alteration of the formant 
the mechanical-to-neural transduction site. loci, and amplitude compression schemes. The methods 

The mechanical-to-neural transformation occurs 2 $ f a »l to recognize the inseparability of the adaptive and 

within the cochlea along a structure called the basilar receptor functions, and only address a part of the neces- 

membrane. This membrane demonstrates excursions sary signal processing functions which must be per- 

which have a position-to-tone relationship. A vast net- formed. Furthermore, the previous methods fail to rec- 

work of neural cells which are sensitive to displacement ognize the highly individual nature of the hearing loss in 

are disposed in rows along the length of the membrane. ^ any patient, and the need for the minimal but general- 

The membrane thus performs a spectral analysis on the ized signal processing to restore recognizable auditory 

incoming sound, directing various portions of the fre- patterns in the auditory cortex of the brain, 

quency spectrum along specific neural channels. The Accordingly, it is an objective of the present inven- 

specific neural cells which are involved in this transduc- tion to provide new and useful methods and means for 

tion process are called the inner and outer hair cells. 35 restoring recognizable auditory communication to per- 

The inner hair cells are in primary relationship with the sons having various deficits in their auditory sensory 

nerves which ascend toward the brain while the outer ajpparatus. It is another object of the present invention 

hair cells are in primary relationship with nerves which to define methods and means for the characterization of 

carry information down from the brain. The exact func- residual hearing function in terms of the spectral and 

tional role of these two neural hair cells types has not 40 adaptive portions of a signal processing system. 

. been conclusively proven. Applicant postulates that the It is another objective of the present invention to 

role of the inner hair cell is that of a pure receptor, and provide a hearing aid system which performs signal 

that this cell initiates electrical signals along its neural processing on an auditory signal in a manner which 

channel to the brain when it is displaced as a result of compensates for the natural signal processing which is 

the motion of the basilar membrane. It is further postu- 45 lost by the failure or destruction of parts of the normal 

lated that the outer hair cell exerts a control function on auditory network. 

the inner hair cell, specifically that it alters the thresh- It is another objective of the present invention to 

old of displacement which must be exceeded before an provide the means for automatically discriminating 

electrical response can be initiated along a given neural important information from noise in the auditory signal 

pathway. Hence the inner and outer hair cells comprise 50 in an effort to restdre the adaptive portion of the hear- 

the sending and modifying functions of an adaptive ing function. 

control system.. It follows that there is an adaptive por- It is another objective of the present invention to 
tion to the hearing system, that it is responsible for the provide the means for shifting, in a physiologically 
high degree of pitch discrimination in humans and . compatible manner, portions of the frequency spectrum 
higher animals, that disease processes affect both the 55 of the auditory signal toward viable neural channels in 
receptor inner hair cells and the adaptive controller the auditory organ system, 
outer hair cells, and, finally, that the structure places SUMMARY OF THE INVENTION 
. physiological constraints on the remedial signal pro- . oummaky ur< I tit invention 
cessing which can be performed by any hearing aid. In accordance with one aspect of the invention, a 
Conventional hearing aids serve as amplifiers of the 60 signal processing apparatus is provided which receives 
auditory signal. The presentation of an amplified signal . a first acoustic signal and generates a second acoustic 
does provide a means for restoring the conductive func- signal with a modified pattern in response to the first 
tions of the ear. However, amplification alone is of only signal. The apparatus includes means for initially re- 
marginal help if the mechanical-to-neural structure has ceiving the first acoustic signal and generating a repre- 
been damaged. In these cases the neural channels that 65 sentative processed signal. Portions of this generated 
carry specific frequencies to the brain and their contri- signal which do not exceed a predetermined pattern 
bution to the adaptivity function have been lost Under recognition function are then suppressed by an adaptive 
extreme amplification, the excursion of the basilar mem- noise cancelling means. The signal produced by the 
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adaptive noise cancelling means is then amplified and FIG. 6a depicts a typical auditory signal of repetitive 

converted into a modified acoustic signal. time period and varying amplitudes in the presence of a 

According to a further aspect of the invention, a competing but lower amplitude periodic noise signal 

hearing aid includes a means for generating a processed FIG. 6b depicts the signal presented in FIG. 6a as 

signal representative of a received acoustic signal. This 3 delayed in time by one major time period of the audi- 

generated signal is applied to a frequency band separat- tory . signal. 

ing means which divides the signal into at least two FIG- ^ depicts the noise cancelling effect of sum- 
separated signals according to frequency. At least one ming a signal delayed by one major time period of the 
of these sepatated signals is directed to a means for auditory signal with a non-delayed signal of similar 
transposing the frequency content to higher or lower 10 shape. 

frequency ranges while maintaining the harmonic rela- FIG. 7 is a detailed schematic of one embodiment of 

tionship characterizing the band separated signal. Fur- * practical electronic circuit for realizing the noise can- 

ther means are provided for temporally matching the celling adaptive filter element of the apparatus, 

band separated signals and for summing the temporally FIG. 8 is a detailed schemata of one embodiment of 

matched signals into a resultant signal which is, in turn , " * praedcal electronic circuit for realizing the segment 

converted into a modified acoustic signal. dc 8 btch window elemcnt of ^ apparatus. 

Yet another aspect of the invention relates to an appa- DESCRIPTION OF THE PREFERRED 

ratus for testing hearing capabilities in humans. The EMBODIMENT 

apparatus includes a means * r J*™^^ 20 Referring now to the drawings and to FIG. 1 in par- 
signal and generating a re ponsive and representat ye ^ *^ ^ 
processed signal. An adaptive noise cancelling means c functions Qf ^ human au {s 
suppresses portions of the generated signal which do An audit0 si j 10 is ljcd to the ^ icrndl 
not exceed a predetermined pattern recognition tunc- eaf and ^ conductive nctwork of the ear M . 
tion. This noise cancelling means also includes means to 2$ ented b box u In this tion of the system the 
variably adjust the characteristics of the pattern recog- acoustic Ufe wave roduced 5y the auditory signal 
nition function as well as means to restrict the frequency fe COnverted int0 m0 vement of the mechanical struc- 
content upon which the pattern recognition is per- tufes Qf ^ middle eaf • m$ mechanical ra0V ement is 
formed. A variable frequency band separating means thefl transmitted t0 th e ba ^ M membrane of the inner 
divides the correlated signal into a plurality of band 3Q ear depicted by box 14 in the illustration of FIG. 1. This . 
limited output signals, each of which is directed to a mec hanically responsive membrane 14 receives me- 
circuit path with a non-linear amplifier for automati- c h an ical stimulus from the middle ear structures and 
cally greater amplifying the lower intensity portions of causes a spC ctrally selective excitation of neural cells 18 
the signal while lesser amplifying its higher intensity commonly known as inner hair cellsj^vhichare disposed 
portions. The non-linear characteristic of the amplifier 35 ai on g its expanse^-On^excitationTA portion.of of thete 
is variable. The testing apparatus further includes means ccellS'18"transmit 3 eSc15icll impulses Talolig .l^ending^] 
for selectively and variably transposing the frequency c^rieurai pathways 20 to the brairi 22. A second portion of 
of the separated signals while maintaining the harmonic neura i signal 23 so generated, and a delayed, evoked 
relationships of said separated signals. neural signal 27 descending from the brain the brain 

BRIEF DESCRIPTION OF THE DRAWINGS 40 P roducc on V* "other set of neural cells 24 

commonly known as outer hatr cells which are also 

The above and other objects, features, and advan- located on the basilar membrane 14. The effect on the 
tages of the present invention will become apparent outer hair cells 24 produced by the combined neural and 
from a consideration of the following detailed descrip- mechanical signals causes the modification indication 
tion presented in connection with the accompanying 45 by path 25 of the local electro-chemical environment of 
drawings in which: inner hair cell 18. The electro-chemical environment 

FIG. 1 shows a schematic depiction of the normal effects the threshold at which the inner hair cell re- 
signal processing functions which comprise the human sponds to mechanical stimulus, 
auditory system. Mechanical motion of the basilar membrane in re- 

FIG. 2a depicts the frequency spectrum of a typical 50 sponse to motion of the middle ear structures initially 
auditory signal and a schematized representation of the stimulates a plurality of both inner and outer hair cell 
effect of a neural hearing loss on the auditory spectrum. groups located at positionsjrfinjixjma^^ 

FIG. 26 depicts the movement of portions of the the membrane.<^EhfeIpolfiol^^ 
auditory spectrum from regions of hearing loss to ^_vated : jiujflci^^ 
higher and lower adjacent frequencies. ss'lceiljis r^ 

FIG. 2c depicts the summation of the so moved por- ^ ^-tbnairaCTtyllwhichlte 
tions of signal with frequency portions of the signal ^^sjrateO? modification of the electro-chemical environ- 
which is addressed to viable portions of the neural audi- ment, as depicted as the process arrow 25 in the illustra- 
tory system. tion, alters the threshold of the inner hair cells 18 and 

FIG. 3 is a schematic of a generalized signal process- 60 results in the local sharpening of the neural spectrum, 
ing apparatus made in accordance with the principles of This sharpened neural response establishes the band- 
the present invention. width of pitch perception. A neural input 26 to the 

* FIG. 4 is a detailed schematic of one embodiment of outer hair cells 24 acts in concordance with mechanical 
a practical electronic circuit for the nonlinear amplifica- input to determine the stimulation of those cells. Signals 
tion element of the apparatus. 65 on the neural input 26 are the summation of neural 

FIG. 5 is a detailed schematic of one embodiment of signals arising from the local inner hair cells 18, from 
a practical electronic circuit for realizing the harmonic other groups of hair cells 28, and from the brain 22. The 
spectral shifting element of the apparatus. other groups of hair cells 28 are located at points along 
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the basilar membrane , t 14;- : which correspond to fre- 
quency spectral differences of approximately one-sixth 
of an octave. Applicant postulates that the contribution 
of the other groups of cells is to modify the activity of 
the outer hair cells 24, and. results in enhanced sharp- 
ness. ..- , t : " m. 1 : 

The mechanical-to-neural portion .of ear perceives 
bands, of excitation which correspond, to.-.^ 
groups in a manner analogous to the function of a spec- 
trum analyzer. Thus the ear is comprised ; Q,f a plurality 
of contiguous receptor/modifier channels, each. haying 
primary responsibility for the. interpretation of a partic- 
ular segment or band of the frequency spectrum. Be- 
cause the mechanical-to-neural transduction process is 
frequency responsive, a loss of selected hair pell groups 
will result in a correspondingly selective loss in the 
audio frequency range.. , , . 

FIG. 2a depicts the frequency spectrum of a typical 
auditory signal as the solid line 31 with its intensity 
plotted on the ordinate versus its frequency plotted on 
the abscissa. The dashed line 32 of FIG. 2a represents 
the filter characteristic of a pathological ear with its 
low-valued portion 33 corresponding to the loss of hair 
cell groups. In the presence of pathologies affecting the 
hair cell groups, the functions of these components are 
lost. Hence both the receptor function of the inner, hair 
cells and the modifying function of the outer hair cells 
fail. The result is twofold: first the primary signal can- 
not be presented to a viable neural ascending channel, 
and second the sharpening of the signal cannot, occur. 
Under such , pathological conditions; the lost : original 
portion 30 of the frequency spectrum cannot be recov- 
ered by simple amplification because no viable neural 
channels exist for its reception. 

FIG. 2b demonstrates the movement of the lost infor- 
mation 36 to viable neural channels. The information in 
the lost band ; is shifted upward and/or downward in 
frequency to be readdressed to the brain via hair cell 
groups which have remained intact The so-called lost 
information 36 which has been so shifted in ajphysiolog- 
ically appropriate manner is then added to the viable 
portions of the receptor spectrum 34 as shown in FIG. 
2c 

A schematic depition of a generalized signal process- 
ing hearing aid apparatus is illustrated in FIG. 3. An 
audio signal is received by a microphone 40 which in 
turn provides an electrical signal to buffer amplifier 42. 
The output signal from buffer amplifier 42 is directed 
. into an adaptive, noise cancelling element 44 for the 
purpose of deleting or suppressing portions of the audi- 
tory signal which do not correlate or have a coincident 
pattern relationship with the strongest dominant fre- 
quency residing in a predetermined range. The resulting 
output signal produced by the adaptive noise canceller 
44 is then applied to a fast attack and slow release type 
automatic gain control amplifier 45, the output of which 
is directed to a frequency band separating network 46. 
This network divides the .signal by means of variable 
bandpass filters 48 according to* frequency content and 
produces a plurality of signals each containing a vari- 
ably selected portion of the frequency spectrum. Each 
of these variably selective portions of the signal spec- 
trum is then input to one of a; plurality of signal modifi- 
cation networks 50. Only one of the signal modification 
networks is shown in detail : in "the drawings, although 
the other -represented networks 50 contain 1 detail ele- 
ments identicakto those described in the sequel- 1 The 
signal modification- netwefrk 50 contains a nonlinear 
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amplifier element 52, a harmonic frequency trans poser 
element 54, a, band filter element 55 and a gainshaping 
amplifier elements 56. The output of each of the signal 
modification networks 50 is input to a summing ampli- 

5 fier 59 through variable attenuating elements associated 
with each signal modification network 50 and collec- 
tively identified on the illustration by the numeral 58. 
.Output from the summing amplifier 59 is directed to a 
power amplifier 70 having suitable impedance charac- 

10 teristics to match its output to an earpiece/speaker 72 
for .transmission, to the patient's defective auditory sys- 
tem. 

FIp. 4 illustrates one example of an amplifier system 
which can serve as the nonlinear amplifier element 52 

15 identified in FIG. 3. The illustrated nonlinear amplifier 
element 52 is a double sided logarithmic type and in- 
cludes an input decoupling capacitor 73 for removing 
.the d.c. offset from the signal. The resulting signal is 
then ^divided into positive and negative portions by 

20 diodes 74 and 77 respectively. The positive portion of 
the signal is then caused to be processed through an 
amplifier stage. 76 employing an NPN transistor feed- 
back element 75 operating in its nonlinear region. Ap- 
propriate passive elements useful to the operation of the 

25 amplifier stages are also indicated in the illustration. A 
logarithmic output from the amplifier stage 76 is thus 
obtained for the positive portion of the signal. The neg- 
ative portion of the signal is similarly processed by the 
logarithmic amplifier stage 79 employing a PNP transis- 

30 tor feedback element 78 operating in its nonlinear re- 
gion. The positive and negative logarithmic output 
signals are then caused to be added together in the 
summing amplifier 80 to provide input for the harmonic 
transposition element shown in detail in FIG. 5. 

35 FIG. 5 illustrates one embodiment of a harmonic 
transposition element 54 for the selective multiplication 
or division of all frequencies by a constant value. The 
movement of all frequencies by a multiplicative process 
retains the harmonic relationships which are present in 

40 the original signal Because of the importance of the 
relationship of harmonics in the recognition of speech 
and other significant acoustic patterns, and because of 
the postulated role of harmonic contribution in the 
mechanical to neural transduction process at the hair 

45 cell level, only harmonic transposition is suitable for 
retention of information content in a form recognizable 
to the brain. 

r. In the illustrated form depicted in FIG. 5, the output 
of the nonlinear amplifier 52 is applied to a time axis 

50 dividing, sampled signal, frequency harmonic transposi- 
tion, system 54 through the agency of an input buffer 
and offset preamplifier 82. This element isolates the 
signal from previous stages and also adds a d.c. voltage. 
The d;C. offset voltage is necessary for the processing of 

55 the signal through a multi-element, storage component 
such as a conventional dual serial analog delay element 
83. One such element is an SAD 1024 manufactured by 
the Reticon Corporation of Sunnyvale, Calif. The iso- 
lated and offset signal is then caused to be input to the 

60 discrete time serial analog memories contained in the 
serial analog element 83. The movement of the signal 
through each serial memory of the analog delay element 
83 occurs in a "bucket brigade" fashion, with the signal 
..being passed from one memory cell or "bucket" to the 

65 next on the command of^ajdgelgrjuhe. Independent 
f cToek*piUsesiare provided to each, memory to achieve 
different delays, or . movements of "information buck- 
ets",- in each memory delay line. 
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In operation, memory 'A* (84) is driven by timing that the amount of information which is discarded be 

pulses from a first clock 'F' 87 arriving through the somewhat less than a phoneme time period. Auditory 

agency of clock switch 92. The buffered, offset signal is sensitivity requires that the sampling frequency He 

input to memory 'A' as a string of sampled data as long above the frequency range for any individual, and it 

as the fast clock interruptor switch 95 remains closed. 5 also requires that the discontinuities occur at the broad- 

The delayed output of memory 'A' is directed to est time intervals. Finally, phonemic temporal restric- 

ground through the agency of audio signal switch 90. tions require that the transposition be accomplished in 

The memory 4 A* (84) as depicted in FIG. 5 is said to be as nearly "real time" as is possible. This last restriction 

in its input cycle. The contents of memory 'A' (84) thus is imposed to preserve lip synchronization, and is partic- 

represents a sampling of the signal with samples being 10 ularly important to persons with hearing deficit. A suitr 

taken at the frequency of clock 'F' 87. During the imme- able set of parameters for the depicted circuit provides 

diately previous positioning of the audio switch 90 and an intermediate delay of 10 to 60 milliseconds using 

clock switch 92, memory ( B' (85) was filled in an identi- clock frequencies in the 15 kHz range and 512 memory 

cal manner. In the depicted position of the clock switch cells. These parameters insure that within a linguisti- 

92 and the audio switch 90, memory *B' (85) is driven by 15 cally distinct period there will be temporal matching of 

timing pulses arriving from a second clock *S* 86. The the signal. 

contents of memory *B' (85) are output to the low pass FIGS. 6a, 6b, and 6c are an expository representation 
filter 96 through the agency of audio switch 90. The of the function of the suppression of noise from "mean- 
memory *B* (85) as depicted in FIG. 5 is said to be in its ingful" auditory signals. The preselection of a "mean- 
output cycle. After clock 'S* has generated the number 20 ingful" auditory signal is postulated on the notion that 
of pulses exactly equal to the number of cells in the speech arises from a vibrating source having a funda- 
memory, primary switch driver 89 causes audio switch mental frequency of less than 500 Hz, and that the modi- 
90 and clock switch 92 to be moved into their other fications or formants which convert the vibrations into 
contact positions. This reverses the functions of the linguistic patterns are correlated with the fundamental 
memories. In this way a memory may be loaded at the 25 or a low harmonic of the vibrating sound source. In 
fast clock rate from clock 'F' 87 and unloaded at the general, the competing noise will not have periods 
relatively slower clock rate from clock *S' 86, the result which coincide with the period or multiples of the per- 
being an apparent division of all frequencies of the sigr iod of the "meaningful" auditory signal, 
nal by a constant amount corresponding to the ratio of In the representation -of FIG. 6a, a "meaningful" 
the slow to fast clock rates. The unload clock 'S' in each 30 auditory signal, as shown by the heavy line 98a, consists 
of the signal modification networks 50 are preferably of four periods V, *b\ 'c\ and *d' of primary information 
synchronized and output at the same rate to provide plus some uncorrected noise signal represented by the 
temporal matching among the signals output from the light, sinusoidal line 986. A time-shifted version of the 
various signal modification networks 50. signals 98a and 986 is depicted in FIG. 6b wherein the 
In general a portion of the signal must be discarded 35 time shift corresponds to exactly one time period of the 
during the frequency division process because no alter- auditory signal. The depicted signal retains three of the 
ation in the temporal period occurs; i.e. the inverse original four periods of the auditory signal. If the signals 
relationship between time and frequency of the signal is of FIG. 6a and FIG. 6b are added together they form a 
violated. As a result, discontinuities normally arise be- new signal as shown in FIG. 6c which reinforces the 
tween the signal segments at each switching of the 40 primary signal and all signals which have time corre- 
memory function. Circuitry contained in the segment lates with it, while simultaneously suppressing all non- 
deglitch window element 94 senses the attributes in the correlated noise signals. 

signal portions prior to switching, and provides means FIG. 7 illustrates one embodiment of an adaptive 
for minimizing such discontinuities. The segment de- noise canceller element 44 for the suppression of noise 
glitch window element 94 causes a moveable "window" 45 signals from meaningful auditory input. The illustrated 
of sample time by variably opening clock interruptor means is based on the correlative principles demon- 
switch 95. The moveable time "window" is caused to strated in FIGS. 6a, 6b, and 6c Within, the element are 
stop when conditions are met which minimize disconti- functional blocks which constitute an autocorrelation 
nuities arising from the switching of the memory func- group 102, a correlation peak group 112, and a correla- 
tions. 50 rive canceller group 126. In the depicted preferred em- 

In a similar manner, well-known memory recircula- bodiment, auto correlation group 102, and peak correla- 
tion schemes may be employed to provide for a continu- tion group 112 together constitute a pattern recognition 
ous signal generation and a variably moving window means. Said means enables the periodic "locking" of a 
when a multiplication of the signal frequency is to be quasi-static signal with a delayed version of itself in the 
accomplished, i.e. when the ratio of the clock rates is 55 correlative canceler group 126. If the signal is a pure 
greater than unity. sinusoid, the elements 102, 112 and 126 perform the 

There are upper and lower restrictions on the delays function of a simple phase locked loop. Similarly,, if the 
which may be imposed on the audio circuit for hearing pattern recognition requirements of the system are re- 
aid applications. These restrictions dictate the ranges laxed to require the recognition of only a single fre- 
for the clock frequencies and, secondarily, they restrict 60 quency, the depicted circuitry may be degenerated to 
the range for the number of cells contained in the mem* constitute a simple phase locked loop, 
ones. These restrictions arise from sampling theory, Operatively, the auditory signal which has been pro- 
linguistic, auditory sensitivity, and temporal bases. Sig- cessed by buffer amplifier 42 of FIG. 3 is caused to enter 
nal theory requires that the sampling rate be at least a splitting junction 104 where it is directed to both the 
twice the frequency of the highest frequency contained 65 autocorrelative group 102 and the correlative canceller 
in the auditory signal and also that at least one complete group 126. Within the autocorrelation group 102 the 
cycle of the lowest frequency of the auditory signal be auditory signal is applied to a bandpass buffer am- 
retained in the memory. Linguistic sensibility demands plifier/filter 105 and thereafter. to both. a delay line 108 
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and to the 'X* input of a multiplier module HO. The by the sound environment and individual hearing loss 
buffer amplifier/bandpass filter facilitates the selection characteristics of the hearing aid wearer, 
of the correlation on a particular frequency portion of The auditory signal which has been directed from 
the original signal. The delay line 108 consists of a num- buffer amplifier element 42 of FIG. 3 into the correla- 
ber of sequential storage elements which cause the sig- 5 tive canceller group 126 first passes through buffer 
nal to be passed from element to element on a clock amplifier 131 and then is caused to follow two pathways 
signal. The clock signal is provided by a voltage con- through the circuitry of the correlative canceller group 
trolled oscillator 106 whose output frequency is caused 126. One of these paths goes through the delay line 130 
to vary linearly in response to the output of a sawtooth which retards its progress by one period of the primary 
waveform generator 107. The portion of the signal 10 frequency of the auditory signal through the means 
passing through the delay line 108 is directed to the *Y* described previously. The other path is a simple unde- 
input of the multiplier module 110. The product of the layed transmission line. The undelayed and the delayed 
nondelayed portion of the signal and the portion of the portions of the signal are then caused to pass through 
signal which has undergone the variable delay is then balancing resistors 132 after which they are added to- 
directed to an integrator circuit 118. Output from the 15 gether in the summing amplifier 134 wherein the signal 
integrator 118 corresponds to a short-time auto-correla- attains the characteristics depicted in FIG. 6c 
tion function: FIG. 8 illustrates one embodiment of a segment de- 
glitch window element 94 for the minimization of tran- 
a sitional discontinuities arising from the joining of origi- 
J ftfift - jtjrfr = AUTOCORRI/W] 20 nally discontiguous signal segments. The illustrated 
tX method is based on the concept of the movement of a 

time "window" over the portion of the signal which is 

The time period of the correlation function is deter- to become the next segment loaded into memory, 

mined by the sawtooth characteristics of the voltage Within the element are functional blocks which consti- 

which controls the oscillator 106 and the integrator 25 tute an auxilliary window memory group 140 and a 

circuit switch 119 characteristics. In the preferred em- segment deglitch logic group 160. 

bodiment, the period is set to substantially correspond Operatively, the window memory group 140 pro-, 

to the fundamental and first harmonic frequencies of vides means for determining the values of trailing por- 

human speech. The correlation function will achieve a tions of a first signal segment and the values of the 

positive maximum value when the delayed signal has 30 leading portions of a next signal segment. A sequential 

been retarded by one period as depicted in FIG. 6b, memory element 144 receives a continuous signal from 

The correlation signal is then directed to the correla- the buffer offset amplifier 82 of FIG. 5. The signal is 
tioh peak group 112 where the time period between then sampled and caused to advance sequentially 
repetitive portions of the auditory signal is determined. through the memory by the agency of clocked pulses 
The correlation signal is directed through diode 117 to 35 arising from clock *F 87 of FIG. 5. Intermediate "taps" 
a positive peak detector module 120. The peak detector are provided along the memory at the locations of the 
module 120 determines the value of the highest power lowest and second lowest, as well as the highest and 
over a composite time period. This composite time second highest memory addresses. The value of the 
period is determined by the correlation function period, sample residing in each of these addresses is thus avail- 
the integrator time constant, and a third time restriction 40 able through the agency of the appropriate tap. 
provided by a refresh clock 121. The refresh clock 121 The samples residing in the lowest and second lowest 
prohibits the peak energy which occurs during one memory addresses are directed to switch 146 where 
portion of a word from being compared with a lesser they are each directed to an element of the multiple 
power exhibited at a linguistically temporally distant sample and hold network 150. Each of the storage ele- 
time. For example, the time between the sounds "pow" 45 ments in the sample and hold network 150 will hold the 
and "er" in the word "power** would be functionally instantaneous value of its input signal upon the applica- 
separated by the refresh clock 121. Output from the tion of the sequence of a logical low followed by a 
positive peak detector 120 and output from the integra- logical high value on the set/reset The sample and hold 
tor 118 are directed into the input of a comparator cir- element will continue to hold the said value until a 
cuit 122 which produces a logical HI state when the 50 low-high sequence is again applied. The appropriate 
values of the peak detector 120 and the integrator 118 logic values are applied alternately to pairs of the sam- 
are nearly identical, A hysteresis type of comparator pie and hold elements through the agency of switch 147 
suppresses the tendency to change the states of the which derives its logic values from output of the cir- 
output in an unstable fashion. The comparator 122 pro- cuitry of segment deglitch logic group 160. The values 
duces a logical valued output through the agency of a 55 . residing on the storage elements are brought out in 
NAND device. In operation, when the current value of alternating pairs through the agency of switch 147. The 
the output of the autocorrelation group 102 and the switches 146, 147 and 148 are caused to change state in 
value of the peak detector 120 are nearly equal, the accordance with a signal provided by the primary 
autocorrelation function is near its optimal time delay. switch driver 89 of FIG. 5. The output of switch 148 
The resulting logical HI state thus . produced on the 60 thus provides the last and the next to last value of the 
comparator 122 is used to "hold" the instantaneous previous signal segment on lines 162 and 164 respec- 
value of the sawtooth waveform generator 107 in the tively. The values of the first and second samples of the 
sample and hold circuit 127. This voltage then holds the new signal segment are taken directly from the highest 
delay line clock 128 at a constant frequency and, in turn, and next highest memory addresses of auxiliary mem- 
produces a delay in the portion of the auditory signal 65 ory 144. The first value is presented on signal line 166, 
passing through delay line 130 equivalent to one period and the second value is presented on signal line 168. 
of the primary frequency of the auditory signal. The The segment deglitch logic group 160 utilizes the 
upper and lower clock frequencies are predetermined information provided by the window memory group 
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140 to perform a hierarchy of logical decisions. These 
decisions determine the starting position of signal seg- 
ment which is to follow the signal segment which is 
immediately in its output function. The decisions pro- 
vide, in order, that (1) a completely full complement of 5 
samples will be available in the memory when it is 
switched to its output function; (2) the amplitude of the 
first sample of the memory being switched into the 
output function will substantially match the amplitude 
of the last sample of the memory which is immediately 10 
in its output function; and (3) the slope of the first sam- 
ples of the memory being switched into the output func- 
tion will substantially match the slope of the last sam- 
ples of the memory which is immediately in its output 
function. Additionally, limits are placed on the amount 15 
of time that the conditions (2) and (3) are permitted to 
be in force. 

The values of the last two signal samples of the mem- 
ory which is immediately units output function are 
communicated to the positive and negative inputs of a 20 
subtraction amplifier element 170 for the purpose of 
calculating the slope of the trailing portion of the identi- 
fied signal segment. Similarly, the values of the first two 
signal samples of the memory which is preparing for its 
output function are communicated to the positive and 25 
negative inputs of a subtraction amplifier element 172 
for the purpose of calculating the slope of the leading 
portion of that identified signal segment. The output 
from said subtractive amplifier 172 is compared with 
the output of said subtractive amplifier 170 at the hyste- 30 
resis comparator 176. The comparator output will be in 
a LO state only when the slopes are nearly equivalent. 
The output of comparator 176 is inverted in the NAND 
device 178, the output of which is directed to the OR 
device 180. The OR device 180 has another input aris- 35 
ing from ripple counter 184. This lead will cause the OR 
device 180 to produce a logical HI state after a prede- 
termined time, whether or not the slope matching con- 
ditions have been satisfied. The ripple counter 184 is 
driven by pulses arising from clock *F ! 87 of FIG. 5, and 40 
is reset to a zero count state at each switching of the 
memory functions by primary switch driver 89 of FIG. 
5. . 

The amplitude values are compared in a similar man- 
ner. The value of the leading sample of the memory 45 
being prepared for input is communicated by signal line 
166 to one input of comparator 186. The amplitude of 
the trailing sample of the memory in immediately in its 
output function is communicated by signal line 162 to 
the reference input of comparator 186. The output of 50 
comparator 186 will be in a LO state when the ampli- 
tudes are nearly equivalent. The output of comparator 
186 is then inverted in the NAND device 188, the out- 
put of which is directed to the OR device 190. The OR 
device 190 has another input arising from ripple counter 35 
184. This other input will cause the OR device to pro- 
duce a logical HI state after a predetermined time, 
whether or not the amplitude matching conditions have 
been satisfied. 

The outputs from the OR devices 180 and 190 are 60 
directed to an AND device 192. A HI output is pro- 
duced on AND device 192 when the slope and ampli- 
tude conditions, or their time default conditions have 
been achieved. Output from AND device 192 serves as 
one of the inputs to a final AND device 198. The other 65 
input to AND device arises from flip-flop device 194. 
The flip-flop device 194 will be caused to obtain a HI . 
state upon receiving a pulse from the ripple counter 184. 
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Said enabling pulse will occur in accordance with a 
predetermined number of pulses of clock *F' 87 of FIG. 
5 which correspond to the number of storage locations 
in the memory. A reset pulse will arising from the pri- 
mary switch driver 89 of FIG. 5 causes the flip-flop 
device 194 to revert to a LO state when the memory 
functions are changed. A logical HI value on the output 
of AND device 198 corresponds to deglitch conditions 
being achieved. 

ALTERNATIVES TO THE PREFERRED 
EMBODIMENT 

While the various elements, groups and circuits 
shown in the preferred embodiment of the preceeding 
FIGS. 3 through 5 and FIGS. 7 and 8 provide a suffi- 
cient system for performing the generalized signal pro- 
cessing subject to this invention, it should be readily 
apparent that optional circuitry can be used to accom- 
plish the various funcitons. Further, future selection and 
utilization of the various alternatives is subject to the 
direction and development of generic technologies. 
Several examples employing alternative contemporary 
technologies to the above described preferred embodi- 
ment are presented. 

The memory devices used in the several delay lines 
83, 108, 130 and 144 are discrete-time analog devices 
which could be replaced by digital storage elements and 
the appropriate analog-to-digital conversion elements. 
The. inverse conversion of the digital-to-analog signal 
would also be required. The band splitting functions 
which are indicated by analog band filters could be 
accomplished by digital filtering techniques such as 
finite impulse response (FIR) or other transversal digi- 
tal filters. The adaptive noise cancelling filter of FIG. 7 
can be accomplished in a variety of ways from very 
simple phase-locked-loop circuits to the use of digital 
computation on the input signal using preprogrammed 
pattern comparison algorithms. The nonlinear amplifier 
element demonstrated in FIG. 5 is a double sided loga- 
rithmic amplifier, however many other amplifiers could 
serve appropriately. In this regard the first stage of a 
recording enhancing device (commonly called 
"Dolby") such as a Signetics Corp. NE570N could 
serve adequately. Finally, a variety of circuit noise 
reduction schemes such as parallel processing of in- 
verted signals (common mode rejection) might advanta- 
geously be employed. The various advantages of the 
aforementioned alternatives would be determined as 
much by cost, and component count factors as by tech- 
nical improvement of the signal processing quality to be 
accomplished. In this regard the aforementioned alter- 
natives are included herein for the sake of completeness, 
and such improvements in circuitry should be obvious 
to those skilled in the application of digital and analog 
electronic integrated circuitry. 

RELATIONSHIP TO THE PHYSIOLOGICAL 
PROCESS OF HEARING 

Referring now to the various FIGS, and particularly 
to FIG. 3, attributes of the invention will be demon- 
strated by describing the function of each element as it 
relates to the enhancement of or substituion for the 
variety of lost physiological processes characteristic of 
hearing deficiency. 

In operation the auditory signal is transduced into an 
electrical signal by the microphone 40 and the buffer 
amplifier 42 in a conventional manner. The adaptive 
noise cancelling element 44 provides a means for sepa- 
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rating the meaningful portion of the auditory signal harmonic relationships in the original signal. Applicant 
from noise, a function which is normally provided by believes that such harmonic retention is significant to 
the neural feedback in the ear. The obfuscation of mean- the optimization of neural cues for recognizing auditory 
ingful information by the addition of competing signals patterns. The effect of the shifting process is to redirect 
is called masking, and in patients having any neural 5 portions of the auditory signal from neurally dead fre- 
hearing deficit, the ability to derive information in the quencies to those neural channels which remain viable 
presence of masking is compromised. The placement of to the transmission of particular frequencies. Shifts 
the adaptive, noise cancelling element 44 hear the front which are made in this manner should be performed 
end of the signal processing therefore provides an auto- only enough to cause enhanced neural cues since distor- 
matic means for compensating for lost masking defini- 10 tion of the auditory signal rises significantly with large 
tion! shifts. However, there is far greater tolerance of shifts in 

The next element in the illustrated signal processing the frequencies above about 2000 Hz than there is in the 
series is an automatic gain control element 45, and it lower frequencies. 

serves the purpose of variously enhancing and suppress- The bandfilter element 55 which receives the trans- 
ing the energy of the acoustic signal. Its physiological 15 posed bandlimited signal serves to limit the energy 
counterpart in the auditory system is bones of the mid- which will drop below the lower frequency limit of the 
die ear, and also in the neural threshold alteration which original band limited signal. The bandfilter element 55 
occurs at the mechanical-to-neural transduction site. In may also be used in a narrow band manner to provide an 
some particular individuals the Automatic gain control acoustic cue representing the entire energy content of 
element 45 also would find' application* to severely re- 20 the band for those cases where an individual retains 
tard signal strength due to hyper-sensitivity to signals only sensitivity for a few tones in the entire auditory 
which occur as a result of depressed neural thresholds spectrum. The signal which is directed into bandfilter 
from certain pathologies of cellular electrolytes. element 55 emerges from through a gainshaping ampli- 

The band separating network 46 provides the means fier 56 to provide a final degree of tuning to the signal, 
for directing specific frequency ranges of the auditory 25 This last mentioned element 55 may be used to compen- 
signal through the processing of the remaining signal sate for subtle differences in the sensitivities of neural 
modification networks 50. Since the perception of the hair cells and structures to mechanical excitation, 
auditory signal occurs on a frequency-by-frequency While the elements represented are required for the 
basis, and because the loss of hearing is directly related most general case of signal processing, their function 
to the failure of certain cells which are responsible for 30 may be so adjusted to provide no net effect if it is not 
certain frequencies, ariy alteration of the auditory signal required. Similarly, the sequence of the functions may 
must also be performed in recognition of the unique also be performed in other than the order described 
frequency/pathology relationship. The band separating herein. 

network 46 performs such a function. The specific num- The separately processed signal bands 50 are next 
ber of bands is dependent upon the pathology of the 35 summed together with various intensity weightings 
individual and also is limited to an upper number by being applied by potentiometers 58 at summing ampli- 
linguistic considerations. For. example an individual fier 59. It is necessary that equivalent time delays be 
having simple high frequency loss might only require provided in each of the signal bands prior to their re- 
severe modification of the frequencies contained in a combination. 

single frequency band from 2500 to 3500 Hz whereas 40 It is readily apparent that if all elements in any of the 
another individual with the capacity to hear only ten signal modifying networks 50 except the frequency 
distinct tones over the entire auditory range might re- transposer element 54 are shunted with regard to the 
quire ten bands, with each generating the single audible signal path, and if both clock *S* 86 and clock 'F 87 
tone. rates are made equal, a pure delay is imposed on that 

The signal which is transmitted in each selected band 45 portion of signal traversing said network. By further 
is directed through a signal modifying network 50. requiring that all of the clock *S' 86 rates be made equal 
Within each of these networks are four distinct elements in all of the individual signal modifying networks 50, 
for performing sj>ecific signal 1 alteration in order to the said delayed signals would provide for the temporal 
optimize the transmission of information contained in or phase matching of all signals processed in the plural- 
the signal over those neural structures which remain 50 ity of signal modifying networks 50 of FIG. 3. 
viable. The bandlimited signal is caused to be processed So similarly may other combined sets of parameters 
through a nonlinear amplifier element. This element in the various elements provide yet other special cases, 
provides for the greater amplification of small ampli- For example, the total energy content of an entire fre- 
tudes of the signal while suppressing the larger ampli- quency band may be represented as a narrowband signal 
tudes. The effect of such processing tends to promote 55 of harmonically related information by a suitable choice 
the effect of sound energies of low power which have of transposition, filtering, and heterodyning, 
sigriificant^formation icohtent such as the consonants DIAGNOSIS AND TREATMENT OF HEARING 
V arid "f\ Such singular devices.have been various y» » loss 

called speech compressors or peak clippers. The detec- 
tion' of the crossing of zero is of much greater impor- 60 Diagnostic methods for the treatment of hearing loss 
tance than is the determination of the amplitude of the employing the means recited above require a significant 
vibrating source as far as the determination of Unguis- departure from contemporary audiological practice, 
tictly significant events is concerned. In contemporary audiology, the pure tone audiogram 

■ , After 1 the band''b^i^'sjgna1' H t£b' been caused to pass is a primary method for evaluating auditory function, 
through the nonlinear amplifier element 52; it enters the 65 This evaluation is performed by presenting the listener 
harmonic frequency with a single-frequency signal and incrementally in- 

mbnic frequencyUramikiset ^ band limited creasing or decreasing the intensity, of the signal. The 

signal is shifted m frequency^ while retaining all of the listener indicates when the tone is audible, and when he 
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indicates that the sound is not audible, a threshold of channels is also influenced by the phonemic require- 
hearing is established for that tone. Then the process is merits of language. 

repeated at typically six or eight more frequencies After the initial signal processing channels are deter- 
spaced at approximately one octave intervals. At the mined using the sweep frequency audiogram, an initial 
conclusion of the test, an "audiogram" is constructed by 5 set of values are chosen for the various gains and gain- 
joining the test points. It is common practice for these shaping elements. The listener is then presented with 
straight line segments to be drawn on either semiloga- well known word discrimination lists, i.e. spoken words 
rithmic or double logarithmic coordinates. These very which are known to differ in subtle ways from other 
qualitative graphs are generally interpreted as a repre- words, and his test scores are taken. On the basts of the 
sentation of the filter characteristics of the listener's 10 types of words that are missed and the spectral content 
auditory system. of those words, the appropriate gain changes, and if 

A substantially more accurate charcterizatidn of the necessary transposition placements and characters are 
auditory system filter characteristics is obtained by altered. The listener is also an active participant in this 
presenting the listener with a constant intensity signal alteration of parameters portion of hearing aid prescript 
which is caused to vary monotonically in frequency. As 15 ti° n - 

the signal slowly sweeps across the sonic frequency Next, a competing noise signal is added to the back- 
range, it is progressively presented to individual hair ground against which the listener is presented the word 
cell groups. As long as there is a normal neural structure discrimination tests. The characteristics of the noise 
and function, the . listener responds to appropriate cancelling and automatic gain control portions of the 
threshold intensity levels. When pathologies affect a 20 master hearing aid are adjusted to provide a maximal 
particular site along the basilar membrane, a sudden response to these tests. Again the parameter adjustment 
"dropout" of the threshold sensitivity occurs, and the is made with the active participation of the listener in 
listener fails to respond. The intensity level is subse- the adjusting procedures. 

quently raised, and a second identification of the "drop- 2J A fine tuning process is the final step in determining 
out" is obtained. The procedure is repeated at higher the the general signal processing required for an indi- 
intensity levels, with the frequency ranges of the sweeps vidual listener. During this final phase, a series of pre- 
narrowed to minimize uncomfortably loud signals from recorded words representing a variety of adult male, 
being addressed to normal portions of the mechano- adult female and child's voices are presented. The rang- 
neural network. 30 ing of parameters responsive to distinguishing language 

The recording of the listener's response can be auto- spoken by these voices is determined, and these parame- 
mated using a conventional X-Y plotter which has a pen ters become the final prescription for an individual hear- 
lifting device. The intensity level is represented as a ing aid. 

voltage on the "Y" input to the plotter, and the fre- While a specific embodiment and method for the 
quency is represented as a voltage on the "X** axis to the 35 purpose of the invention has been disclosed, and alter- 
plotter. The patient causes the pen of the plotter to lift natives to certain elements and procedures have been 
by depressing an electrical switch. As the sound is ad- suggested, it will be appreciated that although each of 
ministered to the patient in a slowly increasing fre- the illustrated elements and suggested steps is desirable 
quency, a constant intensity a line will be drawn across for the most generalized signal processing, some of 
the plotter. In those regions where hearing is lost, the 40 these elements or steps may be so adjusted to produce 
pen will be lifted, and the line will be caused to discon- no net effect, or in special cases, some elements or steps 
tinue. Then the intensity is increased, and a second line may be eliminated entirely. Similarly, it will be appreci- 
is drawn. This process is continued until a filter charac- ated that the sequence of individual signal processing 
teristic of the patient's auditory system is established. elements also may be permuted to address individual 
The sweeping of frequency at a constant intensity is a 45 cases. It will be further appreciated that other circuits to 
most important alteration to the generation of a filter implement the elemental functions will be known to 
characterization of the ear. First, since hearing is sensed those skilled in the art and are to be understood as 
on a frequency by frequency basis, the method permits within the scope of the invention as defined in the ap- 
frequency resolution of the "filter" not otherwise possi- pended claims, 
ble. Second, the method minimizes "recruitment" ef- 50 I claim: 

fects on the filter characterization. Applicant postulates 1. A signal processing apparatus for modifying acous- 
that recruitment, a condition in which a sudden onset of tic patterns, comprising: 

hearing occurs upon the presentation of a gradually (a) means for receiving an acoustic signal and gener- 
increasing stimulus intensity, arises when hair cells adja- ating a processed signal in response thereto, said 

cent to regions of pathology are suddenly brought 55 generated processed signal being representative of 
above their transmitting threshold. Finally, the method the acoustic signal; . . 

enables the identification of the very narrow bands of (b) adaptive noise cancelling means associated with 
frequency reception which may be present in persons said receiving and generating means for suppress- 

who are profoundly deaf to pure tone stimuli which are ing portions of said generated signal which do not 

not addressed to the viable frequencies. 60 exceed a predetermined pattern recognition func- 

The accurate characterizaton of the listener's audi- tion, and producing an output, signal characteristic 

tory channels permits a ranging of the variable parame- thereof; 

ters of a master generalized signal processing hearing (c) frequency band separating means for dividing said 
aid. The number of separate channels which are used generated signal into at least two separated signals 

for the signal processing is dependent upon the number 65 . in accordance to frequency;, = 
of dropouts in the listener's frequency response, their (d) means for selectively, transposing the frequency of 
position along the frequency axis, and their magnitudes. at least one of said separated signals separated by 

The number and frequency position of the separated said frequency band separating means; 
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(e) means for providing temporal matching of said 
separated signal; 

(0 means for summing the temporally matched sig- 
nals into a resultant signal; and 

(g) means for converting said amplified signal into an 5 
acoustic signal. 

2. An apparatus for minimizing transitional disconti- 
nuities arising from the joining of originally discontigu- 
ous signal segments, comprising: 

(a) means for comparing the magnitude of the trailing 10 
edge of a first signal segment with the magnitude of 
the leading edge of a succeeding signal segment; 

(b) means for determining the rate of change of said 
first signal segment's magnitude at the trailing 
edge; 15 

(c) means for determining the rate of change of said 
succeeding signal segment's magnitude at its lead- 
ing edge; and 

(d) means for generating an output signal upon the 
substantial correspondence of both the magnitude 20 
and rate of change of said trailing edge of said first 
signal segment with the magnitude and rate of 
change of said leading edge of said succeeding 
signal segment. 

3. An apparatus as recited in claim 2 further including 25 
means for generating an output signal only upon the 
substantial correspondence of both the magnitude and 
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rate of change of said trailing edge of said first signal 
segment with the magnitude and rate of change of said 
leading edge of said succeeding signal segment and the 
occurrence of a further signal. 

4. An apparatus as recited in claim 2 further including 
a sequential memory element wherein said magnitude 
comparing means and said first signal rate of change 
determining means are responsive to said sequential 
memory element. 

5. An apparatus as recited in claim 4 further including 
alternate memory means for sampling and storing the 
trailing and next-to-trailing portions of a signal in said 
sequential storage element. 

6. An apparatus as recited in claim 5 wherein said 
magnitude comparing means and said succeeding signal 
rate of change determining means are responsive to said 
alternate sampling and storing means. 

7. An apparatus as recited in claim 5 further including 
switching means for alternately connecting each of said 
sampling and storing means to the trailing and next-to- 
trailing storage locations in said sequential storage ele- 
ment and simultaneously out putting the other of said 
alternate sampling and storing means to both of said 
magnitude comparing means and said rate determining 
means for said trailing edge of said first signal segment. 

• * * * * 4 
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